Attorney Docket: 042390.P15810 



APPLICATION FOR UNITED STATES LETTERS PATENT 



FOR 



CONTEXT AND CONTENT SENSITIVE DISTRIBUTED 
APPLICATION ACCELERATION FRAMEWORK 



Inventor(s): Highland Mary Mountain 
Krishnamurthy Srinivasan 
Kevin Brinkley 
Jackson He 



Prepared by: Justin B. Scout, 
Reg. No. 54, 431 



Intel Corporation 

'Express Mail" label number: EV3E552AA17US 



Page 1 



Attorney Docket: 042390.P15810 

CONTEXT AND CONTENT SENSITIVE DISTRIBUTED 
APPLICATION ACCELERATION FRAMEWORK 

BACKGROUND 
5 1. Field 

The present disclosure relates to the attempted acceleration and optimization of a 
distributed application, and, more specifically, to the attempted acceleration and 
optimization of a distributed application utilizing an end-to-end context and/or content 
sensitive framework. 

10 

2. Background Information 

In this context a distributed application is an application of components that 
typically runs in separate runtime environments, usually on different platforms connected 
by a network. Typical distributed applications may be characterized as: two-tier (client- 
15 server), three-tier (client-middleware-server), and n-tier (client-multiple middleware- 
multiple servers). 

It is occasionally desirable to alter the performance of a distributed application to 
reflect the environment {e.g. platform, network, etc.) in which the application in being 
executed. Typically, the performance of a distributed application may be configured in a 
20 generic and static fashion. For example, a distributed application may be statically 
configured to provide rich audio and video content if the application is executed on a 
desktop computer. Conversely, the application may be configured to provide more 
rudimentary audio and video content if the application is executed, for example, on a 
hand-held device, such as a mobile phone. By tailoring the execution and content 
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provided by the application to the execution environment, the speed and general 
performance of the application may be improved. 

Such a static and generic configuration scheme provides a first-order 
approximation necessary to optimize and accelerate the distributed application. 
5 However, the typical optimization scheme is unable to adapt to changes in the execution 
environment of the distributed application and is only capable of dealing with the limited 
number of scenarios statically configured into the system. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

Subject matter is particularly pointed out and distinctly claimed in the concluding 
portions of the specification. The disclosed subject matter, however, both as to 
organization and the method of operation, together with objects, features and advantages 
thereof, may be best understood by a reference to the following detailed description when 
1 5 read with the accompanying drawings in which: 

FIG. 1 is a flowchart illustrating an embodiment of a technique for the attempted 
optimization of a distributed application in accordance with the disclosed subject matter; 

FIG. 2 is a flowchart illustrating an embodiment of a technique for the creation of 
a device and environment database in accordance with the disclosed subject matter; 
20 FIG. 3 is a flowchart illustrating an embodiment of a technique for the creation of 

an application characterization database in accordance with the disclosed subject matter; 
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FIG. 4 is a block diagram illustrating an embodiment of a system that allows for 
the attempted optimization of a distributed application in accordance with the disclosed 
subject matter; and 

FIG. 5 is a block diagram illustrating an embodiment of an apparatus and a 
5 system that allows for the attempted optimization of a distributed application in 
accordance with the disclosed subject matter. 



DETAILED DESCRIPTION 

10 In the following detailed description, numerous details are set forth in order to 

provide a thorough understanding of the present disclosed subject matter. However, it 
will be understood by those skilled in the art that the disclosed subject matter may be 
practiced without these specific details. In other instances, well-known methods, 
procedures, components, and circuits have not been described in detail so as to not 

1 5 obscure the disclosed subject matter. 

FIG. 1 is a flowchart illustrating an embodiment of a technique for the attempted 
optimization of a distributed application in accordance with the disclosed subject matter. 
Block 1 10 illustrates that the application optimization rules and acceleration toolbox may 
be determined. In one embodiment, an accelerator may access a group of statically 

20 configured rules that detail what forms of optimization may be attempted. In a specific 
example, an application may be configured to, for example, only attempt to optimize 
video performance by dropping frames from a transmission. In other examples, the 
application may be allowed to cache the video transmission, reduce the video frame size, 
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r 

or increase the compression of the video. These however, are a few illustrative examples. 
In one embodiment, the acceleration toolbox may include a set of, for example, dynamic 
libraries. One embodiment may include a primitive performance library that is optimized 
to the specific execution platforms. Such a library may include pre-compiled and 
5 optimized code that has been hand tuned to increase performance compared to normal 
libraries. One specific embodiment may include the Intel Primitive Performance (IPP) 
libraries. However, this is merely one specific non-limiting embodiment and other 
embodiments may include other acceleration toolboxes. 

Block 120 illustrates that the current configuration and state of the system of 

10 resource or platforms may be determined. In one embodiment, a system of resources 
may include heterogeneous platforms, such as, for example, different processing units, 
processing architectures, chipsets, peripheral components, operating systems, web service 
consumers or providers, intermediary devices, wired or wireless network gateways, or 
storage capabilities. These however, are merely a few non-limiting examples of a 

15 heterogeneous system of resources that may be utilized to execute a distributed 
application. It is contemplated that the system of resources may be homogeneous. It is 
understood that other systems are within the scope of the disclosed subject matter. 

In one embodiment, a system of resources may include a variety of current state, 
or environment, information, such as, for example, central processing unit (CPU) 

20 utilization, memory availability, battery level, peripheral component utilization and 
availability, network bandwidth capacity, and so on. These however, are merely a few 
non-limiting examples of the current of a state system of resources that may be utilized to 
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execute a distributed application. It is understood that other state information may be 
examined and are within the scope of the disclosed subject matter. 

In one embodiment, the accelerator may utilize a database that details the current 
configuration and state of the system of resources, as illustrated by block 120. In one 
5 embodiment, this database may be referred to as a device and environment database. It is 
contemplated that this database may be integrated or include a number of various data 
sources. It is also contemplated that the database may be statically stored, dynamically 
generated as needed or a combination of the two. 

FIG. 2 is a flowchart illustrating an embodiment of a technique for the creation of 

10 a device and environment database in accordance with the disclosed subject matter. 
Block 210 illustrates that data may be collected from identifiers or sensors within the 
physical system of resources. In one embodiment, the accelerator may determine what 
processor architecture is being used by reading a processor identifier number associated 
with the device. In another embodiment, the current battery level of a device may be 

15 read. It is contemplated that the information may be generated both dynamically and 
statically. In addition, it is contemplated that the identifiers and sensors, in some 
embodiments, may not be within the physical resources, but coupled with the resources 
or generated by resources in response to a query. However, these are merely a few 
examples to which the disclosed subject matter is not limited to. 

20 Block 220 illustrates that the collected data may be analyzed in order to infer an 

execution context characterization. This inferred characterization may provide the 
accelerator with a description of the context or configuration in which the distributed 
application will execute. In one embodiment the execution characterization may include 
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information regarding components, such as, for example, model type, battery model, 
processor architecture, total system memory, firmware, device drivers, etc.; however, 
these are merely a few illustrative examples to which the disclosed subject matter is not 
limited by. In another embodiment, the execution characterization may include 
5 information regarding the hardware, software, firmware, or any combination thereof of 
the system on which the distributed application may execute or interact. 

Block 230 illustrates that the capacity and capabilities of each device within the 
system on which the distributed application may execute or interact may be estimated. In 
one embodiment, the maximum capabilities of the system may be estimated by taking the 

10 execution context characterization and assuming no resources are currently used. The 
current capability may then be estimated by, in one embodiment, utilizing information 
received as part of block 210. In another embodiment, additional data may be collected 
from the system. The current capacity may include abilities, such as, for example, battery 
life, available memory, processor utilization, processor capability, the level of support 

15 provided by the device drivers, etc.; however, these are merely a few illustrative 
examples to which the disclosed subject matter is not limited by. In one embodiment, the 
estimated capacity may include the current used capacity and any system capacity that 
has been currently allocated. 

Block 240 illustrates that the device and environment characterization database 

20 may be updated, or created, utilizing the estimated capacity and inferred execution 
context characterization. It is contemplated that the database may be stored within a 
volatile or non-volatile memory. It is further contemplated that the database may be 
stored in a central local or distributed. 
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Block 130 of Fig. 1 illustrates that the processing requirements of the application 
may be determined. In one embodiment, the determined processing requirements may 
includes requirements, such as, for example, the usage of floating point operations, 
memory usage, resource requirements, expected usage data, or frequently used network 
5 services, etc.; however, these are merely a few illustrative examples to which the 
disclosed subject matter is not limited by. In one embodiment, the processing 
requirements may be determined utilizing a content characterization and execution 
framework analysis. 

In one embodiment, the accelerator may utilize a database that details the content 
10 characterization and execution framework, as illustrated by block 120. In one 
embodiment, this database may be referred to as an application characterization database. 
In one embodiment, the database may include two portions: a static application 
characterization database, and a dynamic application characterization database. It is 
contemplated that the application characterization database may be integrated or include 
15 a number of various data sources. It is also contemplated that the database may be 
statically stored, dynamically generated as needed or a combination of the two. 

In one embodiment, the static application characterization database may be 
created substantially during the compilation of the distributed application. It is 
contemplated that the developer or complier may create a set of meta-data detailing the 
20 expected behaviour and resource usage of the application. In one embodiment this static 
database may be available utilizing the Universal Description Discovery Interface 
(UDDI) or another service discovery protocol for web services through which companies 
may find one another to conduct business. 
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FIG. 3 is a flowchart illustrating an embodiment of a technique for the creation of 
an application characterization database in accordance with the disclosed subject matter. 
Block 310 illustrates that the static application characterization database may be read. In 
one embodiment, the static database may be read from a local source or, conversely, over 
5 the network. 

Block 320 illustrates that the dynamic application characterization database may 
be read. In one embodiment, the static database may be read from a local source or, 
conversely, over the network. It is contemplated that, in one embodiment, during 
initialization of the application database the dynamic database may be empty. In one 
10 embodiment, the dynamic database may include data from a previous execution of the 
distributed application. In one embodiment, the dynamic database may correlate the data 
with a by user. 

Block 330 illustrates that application usage data may be collected. In one 
embodiment application usage data may include data such as, for example, user 

15 preferences, frequently used network services, frequently used data sources, or profiles of 
how the application has previously been used; however, these are merely a few 
illustrative examples to which the disclosed subject matter is not limited by. In one 
embodiment, the data may be collected from a central database, the user's computer, a 
number of distributed data source, or a combination thereof. 

20 Block 340 illustrates that the application usage data may be analyzed. In one 

embodiment, the analysis may identify resource bottlenecks, i.e. areas where the 
performance of the distributed application will be adversely affected. In one 
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embodiment, the analysis may identify network services that are critical to the 
performance of the application. 

Block 350 illustrates that the dynamic application characterization database may 
be updated with the most recent usage data, analysis, or both. It one embodiment, the 
5 static application characterization database may be included with the dynamic database. 
In another embodiment, the dynamic application characterization database may not be 
updated but the application characterization database may be. In one embodiment, the 
technique of Fig. 3 may be repeated, in whole or part, in order to update the dynamic 
database in a substantially constant basis. 

10 Block 140 of Fig. 1 illustrates that once the data, regarding the system of 

resources and the distributed application, have been determined, it may be analyzed in 
order to attempt to optimize that application performance. In one embodiment, the 
optimizations may be done per resource platform or using an end-to-end criteria, such as, 
for example, the application response time as observed by the end-user, power usage, or 

15 memory usage; however, other optimizations are contemplated and within the scope of 
the disclosed subject matter. In one embodiment, examples of optimizations may 
include: downloading new device drivers to a platform, using a primitive performance 
library, specifying compiler optimizations for a Just-In-Time (JIT) complier, altering the 
execution priority of the application during certain stages of execution, dynamically 

20 reordering the order in which portions of the application are executed, or altering the 
quality of data provided by the application; however, these are merely a few illustrative 
examples and other optimizations are within the scope of the disclosed subject matter. 
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Block 150 illustrates that these optimizations may be dynamically applied. In one 
embodiment, the optimizations may be applied utilizing dynamic resource allocation or 
acceleration tools. In one embodiment, the example optimizations illustrated above may 
be attempted by, for example, caching or offloading a particular application module or 
5 data to a system resource, using an performance primitive library for an appropriate 
portion of the application execution, utilizing an additional off-loading processing 
capability to execute the application via locally installed hardware or anther network 
recourse; however, these are merely a few illustrative examples and other optimizations 
are within the scope of the disclosed subject matter. 

10 Block 190 illustrates that in one embodiment, the acceleration or chosen 

optimization of the distributed application may be monitored during execution. The 
actual optimization results may be compared to the expected optimization results. This 
empirical data may, in one embodiment, be used to update the device and application 
databases. The empirical data may also be used to dynamically alter the selected 

15 optimizations and attempt to re-optimize the application. In one embodiment, the 
feedback may be used to adapt to changes in the execution environment of the distributed 
application. However, the disclosed subject matter is not limited by these illustrative 
embodiments. 

FIG. 4 is a block diagram illustrating an embodiment of a system 400 that allows 
20 for the attempted optimization of a distributed application in accordance with the 
disclosed subject matter. In one embodiment, the system may include a distributed 
application 410, an application characterization database 420, a content & context 
sensitive accelerator 450, a device & environment database 480 and a system of resources 
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490 (illustrated by resources 491, 495, & 499). It is contemplated that the system of 
resources may include any number or kind of resources and the three illustrated by Fig. 4 
are merely one illustrative embodiment of the disclosed subject matter. The distributed 
application may execute utilizing the system of resources. 
5 In one embodiment, the content & context sensitive accelerator 450 may attempt 

to optimize execution of the distributed application 410 using a technique described 
above and illustrated by FIG. 1. The device & environment database 480 may, in one 
embodiment, be used as illustrated by FIG. 1 and further illustrated by FIG. 2. The 
application characterization database 420 may, in one embodiment, be used as illustrated 

10 by FIG. 1 and further illustrated by FIG. 3. However, other techniques for utilizing and 
generating the databases are within the scope of the disclosed subject matter. 

In one embodiment, the content & context sensitive accelerator 450 may attempt 
to optimize the execution of the distributed application 410 using the framework libraries 
430, the runtime manager 440, the primitive performance libraries 460, and unmanaged 

15 system software 470. The framework libraries may include reusable common objects and 
code modules. The runtime manager may include the managers such as, for example, a 
operating system, a virtual machine. The primitive performance libraries may include 
code modules that are optimized for a particular platform or architecture. The 
unmanaged system software may include software that competes with the application for 

20 resources or, in one embodiment, is used by the application. The content & context 
sensitive accelerator may attempt to optimize execution of the application utilizing a 
technique described above and illustrated by Fig. 1. 
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FIG. 5 is a block diagram illustrating an embodiment of an apparatus 501 and a 
system 500 that allows for the attempted optimization of a distributed application in 
accordance with the disclosed subject matter. In one embodiment, the apparatus may 
include a dynamic application optimizer 510, a device & environment database 520, an 
5 application characterization database 530, and empirical data 540. It is contemplated 
that, in one embodiment, the application characterization database may include static 
application characterization database 533 and dynamic application characterization 
database 536. 

The Dynamic Application Optimizer 510 may be capable of attempting to 
10 optimize the execution of distributed application 580 on the system of resources 590. In 
one embodiment, the Dynamic Application Optimizer may be a dedicated integrated 
circuit, or, in another embodiment, a generic processing unit. In one embodiment, the 
Dynamic Application Optimizer may be capable of performing the technique described 
above and illustrated in FIG. 1 . However, these are merely a few illustrative examples to 
1 5 which the disclosed subject matter is not limited by. 

The Device & Environment Database 520 may be capable of providing 
information regarding the system of resources 590 that the application 580 will execute 
on or interact with. This information may be utilized by Dynamic Application Optimizer 
510 to optimize the application. In one embodiment, the Device & Environment 
20 Database may be stored within a volatile memory, a non- volatile memory, or a mixture of 
the two. Also, it is contemplated that the Device & Environment Database may be 
centrally located or stored in a distributed fashion. In one embodiment, the Device & 
Environment Database may be constructed utilizing a technique described above and 
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illustrated by FIG. 2. In one embodiment, the Dynamic Application Optimizer may 
construct the database. However, in another embodiment, the Device & Environment 
Database may be constructed, in whole or part, by a separate entity. 

The Application Database 530 may be capable of providing information about the 
5 architecture of the application 580 and how the application is expected to interact with 
the system of resources 590. In one embodiment the Application Database may include 
static application characterization database 533 and dynamic application characterization 
database 536. This information may be utilized by Dynamic Application Optimizer 510 
to optimize the application. In one embodiment, the Application Database may be stored 

10 within a volatile memory, a non- volatile memory, or a mixture of the two. Also, it is 
contemplated that the Application Database may be centrally located or stored in a 
distributed fashion. In one embodiment, the Application Database may be constructed 
utilizing a technique described above and illustrated by FIG. 3. In one embodiment, the 
Dynamic Application Optimizer may construct the database. However, in another 

15 embodiment, the Application Database may be constructed, in whole or part, by a 
separate entity. 

The Empirical Data 540 may be capable of providing information about the 
success, or failure, of the attempted optimization. This information may be utilized by 
Dynamic Application Optimizer 510 to optimize the application 580. In one 
20 embodiment, the Empirical Data may be stored within a volatile memory, a non-volatile 
memory, or a mixture of the two. Also, it is contemplated that the Empirical Data may be 
centrally located or stored in a distributed fashion. In one embodiment, the Empirical 
Data may be constructed utilizing a technique described, above and illustrated by FIG. 1. 
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In one embodiment, the Dynamic Application Optimizer may construct and store the 
data. However, in another embodiment, the Empirical Data may be constructed, in whole 
or part, by a separate entity. 

In one embodiment the system 500 may include a distributed application 580, a 
5 system of resources 590 and the apparatus 501. The system of resources may be capable 
of executing the application. The apparatus may be capable of attempting to optimize the 
execution of the application of the system of resources. In one embodiment, the system 
of resources and application may be capable of providing information to the apparatus 
that facilitates the optimization of the application. 

10 The techniques described herein are not limited to any particular hardware or 

software configuration; they may find applicability in any computing or processing 
environment. The techniques may be implemented in hardware, software, firmware or a 
combination thereof. The techniques may be implemented in programs executing on 
programmable machines such as mobile or stationary computers, personal digital 

15 assistants, and similar devices that each include a processor, a storage medium readable 
or accessible by the processor (including volatile and non-volatile memory and/or storage 
elements), at least one input device, and one or more output devices. Program code is 
applied to the data entered using the input device to perform the functions described and 
to generate output information. The output information may be applied to one or more 

20 output devices. 

Each program may be implemented in a high level procedural or object oriented 
programming language to communicate with a processing system. However, programs 
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may be implemented in assembly or machine language, if desired. In any case, the 
language may be compiled or interpreted. 

Each such program may be stored on a storage medium or device, e.g. compact 
read only memory (CD-ROM), digital versatile disk (DVD), hard disk, firmware, non- 
5 volatile memory, magnetic disk or similar medium or device, that is readable by a general 
or special purpose programmable machine for configuring and operating the machine 
when the storage medium or device is read by the computer to perform the procedures 
described herein. The system may also be considered to be implemented as a machine- 
readable or accessible storage medium, configured with a program, where the storage 

10 medium so configured causes a machine to operate in a specific manner. Other 
embodiments are within the scope of the following claims. 

While certain features of the disclosed subject matter have been illustrated and 
described herein, many modifications, substitutions, changes, and equivalents will now 
occur to those skilled in the art. It is, therefore, to be understood that the appended 

15 claims are intended to cover all such modifications and changes that fall within the true 
spirit of the disclosed subject matter. 
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